Estimation of Rare Event Probabilities Using Cross - Entropy
نویسندگان
چکیده
This paper deals with estimation of probabilities of rare events in static simulation models using a fast adaptive two-stage procedure based on importance sampling and Kullback-Liebler’s cross-entropy (CE). More specifically, at the first stage we estimate the optimal parameter vector in the importance sampling distribution using CE, and at the second stage we estimate the desired rare event probability using importance sampling (likelihood ratios). Some theoretical aspects of the proposed method, including its convergence, are established. The numerical results presented suggest that the method effectively estimates rare event probabilities.
منابع مشابه
Rare-Event Simulation of Non-Markovian Queueing Networks Using a State-Dependent Change of Measure Determined Using Cross-Entropy
A method is described for the efficient estimation of small overflow probabilities in nonMarkovian queueing network models. The method uses importance sampling with a state-dependent change of measure, which is determined adaptively using the cross-entropy method, thus avoiding the need for a detailed mathematical analysis. Experiments show that the use of rescheduling is needed in order to get...
متن کاملThe Cross-Entropy Method for Estimation
This chapter describes how difficult statistical estimation problems can often be solved efficiently by means of the cross-entropy (CE) method. The CE method can be viewed as an adaptive importance sampling procedure that uses the cross-entropy or Kullback–Leibler divergence as a measure of closeness between two sampling distributions. The CE method is particularly useful for the estimation of ...
متن کاملAdaptive Importance Sampling Simulation of Queueing Networks
In this paper, a method is presented for the efficient estimation of rare-event (overflow) probabilities in Jackson queueing networks using importance sampling. The method differs in two ways from methods discussed in most earlier literature: the change of measure is state-dependent, i.e., it is a function of the content of the buffers, and the change of measure is determined using a cross-entr...
متن کاملImportance Sampling Simulations of Markovian Reliability Systems Using Cross-Entropy
This paper reports simulation experiments, applying the cross entropy method such as the importance sampling algorithm for efficient estimation of rare event probabilities in Markovian reliability systems. The method is compared to various failure biasing schemes that have been proved to give estimators with bounded relative errors. The results from the experiments indicate a considerable impro...
متن کاملSplit Sampling: Expectations, Normalisation and Rare Events
In this paper we develop a methodology that we call split sampling methods to estimate high dimensional expectations and rare event probabilities. Split sampling uses an auxiliary variable MCMC simulation and expresses the expectation of interest as an integrated set of rare event probabilities. We derive our estimator from a Rao-Blackwellised estimate of a marginal auxiliary variable distribut...
متن کامل